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Abstract. A many-server queueing system is considered in which customers 
arrive according to a renewal process, and have service and patience times 
that are drawn from two independent sequences of independent, identically 
distributed random variables. Customers enter service in the order of arrival 
and are assumed to abandon the queue if the waiting time in queue exceeds 
the patience time. The state y(^) of the system with N servers is represented 
by a four-component process that consists of the backward recurrence time of 
the arrival process, a pair of measure-valued processes, one that keeps track 
of the waiting times of customers in queue and the other that keeps track of 
the amounts of time customers present in the system have been in service, 
and a real-valued process that represents the total number of customers in 
the system. Under general assumptions, it is first shown that yC^) is a Feller 
process, admits a stationary distribution and is ergodic. The main result 
shows that when the associated fluid limit has a unique invariant state then 
any sequence {y C^) /A''}jvgN of stationary distributions of the scaled processes 
converges, as A*^ ^ oo, to this state. In addition, a simple example is given to 
illustrate that, both in the presence and absence of abandonments, the N oo 
and t — > oo limits cannot always be interchanged. The stationary behavior of 
many-server systems is of interest for performance analysis of computer data 
systems and call centers. 
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1. Introduction 

1.1. Description. An TV-server queueing system is considered in wlriclr customers 
arrive according to a renewal process, tiave independent and identically distributed 
(i.i.d.) service requirements that are drawn from a general distribution with finite 
mean and also carry i.i.d. patience times that are drawn from another general 
distribution. Customers enter service, in the order of arrival, as soon as an idle 
server is available, service is non-preemptive and customers abandon the queue if 
the time spent waiting in queue reaches the patience time. This system is also 
sometimes referred to as the GI/G/N+G model. In this work, it is assumed that 
the sequences of service requirements and patience times are mutually independent, 
and that the interarrival, service and patience time distributions have densities. 

The state of the A'^-server system is represented by a four component process 
Y^-'^') , consisting of the backward recurrence time process associated with the re- 
newal arrival process, a measure- valued process that keeps track of the amounts of 
time customers currently in service have been in service, another measure-valued 
process that encodes the times elapsed since customers have entered the system 
(for all customers for which this time has not yet exceeded their patience times), 
and a real-valued process that keeps track of the total number of customers in the 
system. This infinite-dimensional state representation was shown in Lemma B.l of 
[l4] to lead to a Markovian description of the dynamics (with respect to a suitable 
filtration). In addition, a fiuid limit for this model was also established in [14) . 
i.e., under suitable assumptions, it was shown that almost surely, F^^) = Y'-^'^ /N 
converges, as iV — >■ oo, to the fiuid limit Y, which is characterized as the unique 
solution to a set of coupled integral equations (see Definition 15. 1|) . 

The present work focuses on obtaining first-order approximations to the sta- 
tionary distribution of Y^-^\ which is of fundamental interest for the performance 
analysis of many-server queues. In particular, this work addresses several questions 
that were raised in Whitt [21]. It is first shown that for each iV, y(^) is a Feller, 
strong Markov process and has a stationary distribution. Under an additional as- 
sumption (see Assumption IH) , the ergodicity of each y(^) is also established. The 
main result. Theorem 13.31 shows that if the fiuid limit has a unique invariant state, 
then any sequence of scaled stationary distributions converges, as A^ oo, to this 
unique invariant state. More generally, this work seeks to illustrate how an infinite- 
dimensional Markovian representation of a stochastic network can facilitate the 
(first-order) characterization of the associated stationary distributions. Moreover, 
examples are presented in Section [7] to illustrate some subtleties in the dynamics 
and to show that the t ^ oo and N ^ oo limits cannot in general be interchanged. 

1.2. Motivation and Context. The study of many-server queueing systems with 
abandonment is motivated by applications to telephone call centers and (more 
generally) customer contact centers. The incorporation of customer abandonment 
captures the effect of customers' impatience, which has a substantial impact on the 
performance of the system. For example, customer abandonment can stabilize a 
system even when it is overloaded. A considerable body of work has been devoted to 
the study of various steady-state or stationary performance measures of many-server 
queues, both with and without abandonment. In the absence of abandonment, when 
the interarrival times and service times are exponential, an explicit expression for 
the steady state queue length can be found in ^ , while the classical work of Kiefer 
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and Wolfowitz [T^ (see also Foss ^) establishes the convergence of waiting time 
processes (or vectors) in discrete time when the i.i.d. interarrival and service times 
are generally distributed. The case of continuous time is dealt with in fT . For a 
many-server queue with stationary renewal arrivals, deterministic service times and 
no abandonments, Jelenkovic, Mandelbaum and Momcilovic [13^ showed that on the 
diffusive scale, the scaled stationary waiting times converge in distribution to the 
supremum of a Gaussian random walk with negative drift. For a many-server queue 
with stationary renewal arrivals, a finitely supported, lattice- valued service time 
distribution and no abandonments, Gamarnik and Momcilovic [S" characterized 
the limiting scaled stationary queue length distribution in terms of the stationary 
distribution of an explicitly constructed Markov chain and obtained an explicit 
expression for the exponential decay rate of the moment generating function of the 
limiting stationary queue length. 

For many-server queues with abandonment whose interarrival, service and aban- 
donment distributions are exponential, Garnett, Mandelbaum and Reiman TO' pro- 
vide exact calculations of various steady state performance measures and their 
approximations in the diffusive scale, both in the case of finite waiting rooms 
(M/M/N/B-hM) and infinite waiting rooms (M/M/N-fM). In the case of Pois- 
son arrivals, exponential service distribution and general abandonment distribu- 
tion (M/M/N+G), explicit formulae for the steady state distributions of the queue 
length and virtual waiting time were obtained by Baccelli and Hebuterne ^ (see 
Sections IV and V.2 therein), while several other steady state performance mea- 
sures and their asymptotic approximations, in the limit as the arrival rates and 
servers go to infinity, were derived by Mandelbaum and Zeltyn [18 . 

In the previously mentioned works on characterization of stationary distributions 
of many-server queues, either the interarrival times and service times are assumed 
to be exponential or the service times are discrete and there is no abandonment. 
However, statistical analysis of real call centers has shown that both service times 
and patience times are typically not exponentially distributed [Sj [18], thus pro- 
viding strong motivation for this work. In general, it is difficult to derive explicit 
expressions for the stationary distributions of many-server queues, especially in the 
realistic case when service times are non-exponential and there is abandonment. 
This is also the case for many other classes of stochastic networks. To resolve this 
issue, a common approach that is taken is to identify the long time limit of the fluid 
or diffusion approximations, which is often more tractable, and then use this limit 
as an approximation for the stationary distribution of the original system. Such an 
approach relies on the premise that the long time behavior of the fluid limit can 
be characterized, and also requires an argument that justifies the interchange of 
(the iV — )■ oo and t oo) limits (see, for example, 9 for an interchange of limits 
result in the context of generalized Jackson networks). However, we show that this 
approach may not always be appropriate for stochastic network models. Indeed, 
for the case of many-server queues with non-exponential service distributions, the 
long-time behavior of the fiuid is subtle and difficult to characterize, in large part 
due to the complexity in the dynamics introduced by the coupling of the measure- 
valued component of the fluid limit with the positive real-valued component by 
the non-idling condition. Furthermore, as the example we construct in Section [7] 
demonstrates, in general the order of the N ^ oo and t ^ oo limits cannot be inter- 
changed. Instead, we take a different approach to showing convergence, which uses 
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a representation formula for the dynamics of the measure-valued state processes 
(see Proposition 12. 

1.3. Outline. The outline of the paper is as follows. A precise mathematical de- 
scription of the model is provided in Section [5] Section [3] introduces the basic 
assumptions and states the main result. The Feller property and the existence of 
stationary distributions of the state descriptor are proved in Section |4l The fluid 
equations and the invariant manifold are described in Section [5l and the asymp- 
totics of the stationary distributions is established in Section [6l Finally, positive 
Harris recurrence and ergodicity of the state descriptor, the long time behavior of 
the fluid limit and an example that shows that the "interchange of limits" property 
docs not always hold are discussed in Section [T] In the remainder of this section, 
we introduce some common notation used in the paper. 

1.4. Notation and Terminology. The following notation will be used throughout 
the paper. Z is the set of integers, N is the set of positive integers, M is the set of real 
numbers, Z+ is the set of non-negative integers and the set of non-negative real 
numbers. For a, 6 G M, aV5 denotes the maximum of a and b, aAb the minimum of 
a and b and the short-hand a"*" is used for a V 0. Is denotes the indicator function 
of the set B (that is, 1Lb(x) = 1 if x ^ B and 1b(x) = otherwise). 

1.4.1. Function and Measure Spaces. Given any metric space E, Cb{E) and Cc{E) 
are, respectively, the space of bounded, continuous functions and the space of con- 
tinuous real- valued functions with compact support defined on E. Given a nonde- 
creasing function / on [0, cxi), denotes the inverse function of / in the sense 
that f^^{y) — ini{x > : f{x) > y}. The support of a function (p is denoted by 
supp((^). 

The space of Radon measures on a metric space E, endowed with the Borel a- 
algebra, is denoted by M{E), while Mf{E) is the subspace of finite measures in 
A4{E). Recall that a Radon measure is one that assigns finite measure to every 
relatively compact subset of R+ . By identifying a Radon measure /i G A4 (E) with 
the mapping on Cc{E) defined by 



one can equivalently define a Radon measure on i? as a linear mapping from Cc{E) 
into M such that for every compact set K. C E, there exists Ljc < oo such that 



The space J^f{E) is equipped with the weak topology, i.e., a sequence of measures 
in A4f{E) is said to converge to /i in the weak topology (denoted /z„ fi) if 
and only if for every ip G Cb{E), 



As is well-known, Mf{E), endowed with the weak topology, is a Polish space. 
The symbol Sx will be used to denote the measure with unit mass at the point x 
and, by some abuse of notation, we will use to denote the identically zero Radon 
measure on E. When E is an interval, say [0,H), for notational conciseness, we 
will often write Ai[0, H) instead of A^([0, H)). For any Borel measurable function 






(1.1) 




as n — > oo. 
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/ : [0,i?) ^ M that is integrable with respect to £ M[0,H), we often use the 
short-hand notation 



J[0,H) 

Also, for ease of notation, given ^ G Ai[0,H) and an interval (a, &) C [0,M), we 
will use ^(a, b) to denote ^{{a, b)). 

1.4.2. Measure-valued Stochastic Processes. Given a Polish space H, we denote 
by V-uiO^T] (respectively, ^-^[OjOo)) the space of "H- valued, cadlag functions on 
[0, T] (respectively, [0, oo)), and we endow this space with the usual Skorokhod Ji- 
topology [20]. Then Vfi[0, T] and V-hIO, oo) are also Polish spaces (see [20]). In this 
work, we will be interested in valued stochastic processes, where H = Mf[0, H) 
for some H < oo . These are random elements that are defined on a probability 
space (f2,J^, P) and take values in 2?-h[0, oo), equipped with the Borel cr-algebra 
(generated by open sets under the Skorokhod Ji-topology). A sequence {X„} of 
cadlag, ?^-valued processes, with X„ defined on the probability space (r2„, P„), 
is said to converge in distribution to a cadlag 'H-valued process X defined on 
(ri, J^, P) if, for every bounded, continuous functional F : V-u[0,(x) R, we have 



where E„ and E are the expectation operators with respect to the probability 
measures P^ and P, respectively. Convergence in distribution of X„ to X will be 
denoted by Xn ==> X. Let Ir^ [0, oo) be the subset of non-decreasing functions 



In Section 12.11 we describe the basic model, which is sometimes referred to as 
the GI/G/N-t-G model. In Section 12.21 we introduce the state descriptor, some 
auxiliary processes, and describe the state dynamics, and in Section [2731 we obtain 
a convenient representation formula for expectations of linear functionals of the 
measure-valued components of the state process. In Section 12. 4| we introduce a 
filtration, with respect to which the state descriptor is an adapted, strong Markov 
process. This model was also considered in T4^, where functional strong law of large 
numbers limit for the state descriptor was established as the number of servers and 
the mean arrival rate both tend to infinity. 

2.1. Model Description and Primitive Data. Consider a queueing system with 
N identical servers, in which arriving customers are served in a non-idling, First- 
Come-First-Serve (FCFS) manner, i.e., a newly arriving customer immediately en- 
ters service if there are any idle servers or, if all servers are busy, then the customer 
joins the back of the queue, and the customer at the head of the queue (if one is 
present) enters service as soon as a server becomes free. 

It is assumed that customers are impatient, and that a customer reneges from the 
queue as soon as the amount of time he or she has waited in the queue reaches his 
or her patience time. Customers do not renege once they have entered service, and 
service is non-preemptive. The patience times of customers are given by an i.i.d. 
sequence, {r^, i G Z}, with common cumulative distribution function C on [0, oo], 
while the service requirements of customers are given by another i.i.d. sequence, 
{wi, i G Z}, with common cumulative distribution function ff* on [0, oo). For i e N, 





lim E„ [F{Xn)] = E [F{X) 



/ePM+[0,oo) with /(O) -0. 
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Ti and Vi represent, respectively, the patience time and the service requirement of 
the ith customer to enter the system after time zero, while {r-i, i E — N U {0}} 
and {vi, i G — N U {0}} represent, respectively, the patience times and the service 
requirements of customers that arrived prior to time zero (if such customers exist), 
ordered according to their arrival times (prior to time zero) . We assume that has 
density 5^ and G"", restricted to [0, 00), has density g^. This implies, in particular, 
that G"'(0+) = 0^(0+) = 0. Let 

H'' ^ sup{x e [0, 00) : ^(x) < 1}, 
= svLp{x e [0, 00) : G'{x) < 1}. 

The superscript (N) will be used to refer to quantities associated with the system 
with N servers. 

Let iS^^) denote the cumulative arrival process associated with the system with 
N servers, with E^^^{t) representing the total number of customers that arrive into 
the system in the time interval [0,^]. We assume that E'^^^ is a renewal process 
with a common interarrival distribution function F^^\ which has finite mean. Let 
A(^) be the inverse of the mean of i.e., 

poo 

AW / xFW(dx) = l. 

The number A*-^-* represents the long-run average arrival rate of customers to the 
system with N servers. We assume E^^\ the sequence of service requirements 
{vj,j G Z}, and the sequence of patience times {rj,j G Z} are mutually inde- 
pendent. Let o;^'* be a cadlag, real- valued process defined by a^^\s) = s if 
£:(^)(s) = and, if E^^\s) > 0, then 

a(f ) {s)^s-sup{u<s: E^''^ {u) < E^''^ (s) } , 

which denotes the time elapsed since the last arrival. Then is simply the 

backward recurrence time process, which completely determines the cumulative 
arrival process LetfW be an a.s. Z+-valued random variable that represents 

the number of customers that entered the system prior to time zero. This random 
variable does not play an important role in the analysis. It is used, for bookkeeping 
purposes, to keep track of the indices of customers. 

2.2. State Descriptor. A Markovian description of the state of the system with 
N servers would require one to keep track of the residual or elapsed patience times 
and the residual or elapsed service times of each customer present in the queue or 
in service. In order to do this in a succinct manner, with a common state space 
for all A^-server systems, we use the representation introduced in [14]. The state of 
the A-server system consists of the backward recurrence time of the renewal 
arrival process, a non-negative real- valued process X'-^\ which represents the total 
number of customers in system with A^ servers (including those in service and those 
in queue) and a pair of measure- valued processes, the "age measure" process, 
which encodes the amounts of time that customers currently receiving service have 
been in service and the "potential queue measure" process, ry^^^ which keeps track 
not only of the waiting times of customers in queue, but also of the potential waiting 
times (defined to be the times since entry into system) of all customers (irrespective 
of whether they have already entered service and possibly departed the system). 
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for whom the potential waiting time has not exceeded the patience time. Thus, the 
state of the system, denoted by Y^^\ takes the form 

(2.2) - (a(f\xW,z.W,77W). 

Note that X*^^^ and 77*^^' , together, yield the waiting times of customers currently 
in queue. Indeed, for t G [0, 00), let Q'^^^t) be the number of customers waiting in 
queue at time t. Due to the non-idling condition, the queue length process is then 
given by 

QW(i) = [xW(i)-iV] + . 

Since it is clear that 

(2.3) = (l,z.W) + gW, 
the non-idling condition is equivalent to 

(2.4) iV- (1,1/^^)) = [iV_XW] + . 

Moreover, since the head-of-the-line customer is the customer in queue with the 
longest waiting time, the quantity 

(2.5) x'^'Ht) = inf {x > : ryW[0,x] > QW(t)} = (W"')"' (Q(^)(t)) 

represents the waiting time of the head-of-the-line customer in the queue at time 
t. Since this is an FCFS system, any mass in r]^'^^ that lies to the right of x'-^-'(t) 
represents a customer that has already entered service by time t. Therefore, the 
queue length process Q^^^ admits the following alternative representation in terms 
ofx^"^' and 77 W: 

(2.6) g(^)(t) = r7r)[0,x(^Ht)]. 

The following auxiliary processes are useful for the evolution of the system and can 
be recovered from the state of the system f(^) by using equations (2.9)-(2.11) and 
(2.14) in [H]: 

• the cumulative reneging process R^'^\ where R'-^^{t) is the cumulative 
number of customers that have reneged from the system in the time interval 
[0,t]; 

• the cumulative potential reneging process S^-^\ where S^^''{t) represents 
the cumulative number of customers whose potential waiting times have 
reached their patience times in the interval [0,t]; 

• the cumulative departure process D^-'^\ where D^^\t) is the cumulative 
number of customers that have departed the system after completion of 
service in the interval [0,t\; 

• the process K^-^\ where K'^'^\t) represents the cumulative number of cus- 
tomers that have entered service in the interval [0,i]. 

It is easy to see the following mass balance for the number of customers in queue 
hold: 

(2.7) g(^) (0) + = Q(^) + + if . 
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2.3. A Useful Representation Formula. We now establish representation for- 
mulas for expectations of linear functionals of the age and potential queue measure- 
valued processes. These are used to establish tightness of sequences of stationary 
distributions in Section |42] 



Proposition 2.1. For each bounded measurable function f on and t > 0, 



(2.8) 

and 
(2.9) 



E 



= E 



-E 



E 



= E 



-E 



ioM^r ' 1-G^(.) ^0 ^^^^ 



/(t_s)(l-G"-(t-s))di?W(s) 



[O.H") i - Lr [X) 

' f{t-s)il-G^{t-s))dK^^\s) 



Proof. We only prove (|2.8p since the proof of (|2.9p is exactly analogous. Fix ip G 
Cc(IR.'^). Suppose (p has compact support in [0,r] x [0,m] for some T < oo and 
m < if. Then, by the analog of (5.18) in Proposition 5.1(2) of [M] and (3.36) of 
[I4] , it follows that 



E 



(^(•,s)/^'■(•),r/W)d5 



<C(m,T) II^IL, 



where 



C{m,T) = 2(^j'\'{x)d^ E[X(^)(0) + ^(^)(T)] < 



On the other hand, let e^(t) = E[£;(^)(i)], t > 0. Then, taking expectations in 
(2.28) of Theorem 2.1 of [M] and using the fact that, for any bounded, continuous 
function if on K^, by Proposition 5.1(2) of [T4] . 



E 



E 



{p{-,sWi-),r,i^^)ds 



(^(■,s)r(-),E 



)ds, 



we conclude that for every t > 0, 
{^{■,t),E[rjn = (^(,0),E[,/W])+ / {M;^) + vA-:s),E[7^nds 



{^{■,s)h^{-),E[4''^])ds+ / ^(0,s)deW(s). 

i[o,t] 

Thus, we have shown that the inequality (4.1) and equation (4.2) of [14] are satisfied 

with {7fs}s>o, Z and h replaced, respectively, by {E[r7i^^]}s>o, e^''^^ and h'^. The 
result then follows from Proposition 4.1 of [M] since (4.3) of [M] reduces to p.8p . 
after the appropriate substitutions are made. □ 
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2.4. State Space and Filtration. The total number of customers in service at 
time t is given by 

and is bounded above by the number of servers N. On the other hand, it is clear 
(see, e.g., (2.13) of [14 ) that a.s., for every t S [0, oo), 

= vr[o,Hn < Ei^\t) + < i?(^Ht) +fr < oo. 

Therefore, a.s., for every t G [0,oo), i^^^^ G Mf[0,H') and 4^^^ G Mf[0,H'-). 

Let ^AD[0,H^) be the subset of measures in Mf[0, H^) that can be represented 
as the sum of a finite number of unit Dirac measures in [0, If), i.e., measures 
that take the form J2i=i^xi for some k G Z+ and Xi G [0,H^), i = I,-- - ,k. 
Analogously, let Md[0,H^) be the subset of Mf[0,H^) that can be expressed as 
the sum of a finite number of imit Dirac measures in [0, H^). Also, define 

{a,x,n,T:) eR+xZ+x Md[0,H'') x MdIO^H"^) : \ 
x<{l,fi) + {l,Tr), {l,^i)<N /' 

where R-i- is endowed with the Euclidean topology d, is endowed with the 
discrete topology p, and Md[0,H^) and Md[0,H'^) are both endowed with the 
topology of weak convergence. The space y^^^ is a closed subset of IR+ x Z_|- x 
Mf[0,H'^) X Mf[0,H^) and is endowed with the usual product topology. Since 
M+ xZ+ X Mf[Q, H'') X Mf[0,H^') is a Polish space, the closed subset 3^^^^ is also 
a Polish space. It follows from the representations of uj:^^ and ry^^' in (2.3) and 
(2.8) of [Hj that a.s., the state descriptor Y'^^^t) takes values in 3^^^^ for every 
t G [0,oo). 

For t G [0, oo), let -F/^-* be the cr-algebra generated by 

where s*^^-* = {s^j^\j G Z) is the "station process", defined on the same probability 
space {fl,J-,P). For each t G [0, oo), if customer j has already entered service by 
time t, then s^j^\t) is equal to the index i G {1, . . . , N} of the station at which 

customer j receives service and s'^^\t) = otherwise. Let {J-^^^} denote the 
associated right-continuous filtration, completed with respect to P. It is proved in 
Appendix A of P3] that the state descriptor y(^) and the auxiliary processes 
Q(N)^ S'(^), and are cadlag and adapted to the filtration {T^^'^j. 

Moreover, from Lemma B.l of [14|, it follows that F(^) is a strong Markov process 
with respect to the filtration {J^t^^}- 

3. Assumptions and Main Results 

The main focus of this paper is to obtain a "first-order" approximation for the 
stationary distribution of the TV-server queue, which is accurate in the limit as the 
number of servers goes to infinity. 

3.1. Basic Assumptions. We impose the following mild first moment assumption 
on the patience and service time distribution functions G"" and G" . Without loss of 
generality, we can normalize the service time distribution, so that its mean equals 
1. 



(2.10) y^) = 
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Assumption 1. The mean patience and service times are finite: 

(3.11) 9'' = [ xg''{x)dx=^ [ {l-C'ix)) dx <oo, 

J[0,oo) J[0,oo) 

and 

(3.12) / xg'ix)dx:== [ {1 - G' {x)) dx ^ 1. 
"'[0,00) "'[0,00) 

Let and r]^ be the probability measures defined as follows: 

(3.13) iy40,x) - / il-G'iy))dy, xe[0,H'), 

Jo 

(3.14) 77,[0,x) = r{\-G-{y))dy, xG[0,H'). 

Jo 

Note that i'^ and 77^ are well-defined due to Assumption [T] For A > 1, define the 
set B\ as follows: 

(3.15) = |x e [1,00) : G'- [{F^^')-' ((x - 1)+)) = ^| . 
Let 

— inf {x e [1, 00) : x £ Bx} and 6^ = sup {x e [1, 00) : x e Bx} . 

Since the functions G"" and are continuous and non-decreasing, we have Bx = 
[5;'*', b^]. Let Ix be the set of states defined by 



(3.16) Ix = 



{(A, Ai/,,A?7,)} if A < 1, 

{(x*, I/*, Ary*) : X, G -Ba} if A > 1. 

We show in Theorem 15.51 that Ix describes the so-called invariant manifold for the 
fluid limit. Suppose that Ix satisfies the following assumption. 

Assumption 2. The set Ix has a single element. 

Note that this is a non-trivial restriction only when A > 1. A sufficient condition 
for Assumption [2] to hold is as follows. 

Lemma 3.1. // either A < 1, or A G [1, 00) and equation 
(3.17) G'-(x) = ^ 

has a unique solution, then Assumption\^holds. In particular, this is true if G^ is 
strictly increasing. 

Proof. Fix A G [l,cxo). It suffices to show that the set Bx in p.l5p consists of a 
single point. Since the equation in p.l7p has a unique solution and the function 
(F^''*)~^(-) is strictly increasing on [0, XO^), the equation 



G' 



((F--)-^((x-l)+)) 



A - 1 



A 

has a unique solution. Thus Bx has a single element and the lemma follows. □ 
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For each N e N, let Y^^^ = {a^^\x^^\v'^'^\fi'^^'>) be the fluid scaled state 
descriptor defined as follows: 

(3.18) o^E W = "is W> X [t):^ 



N 



(3.19) i/i '(B) = , ril '{B) = — — — , 

for t e [0, oo) and any Borel subset B of M-(_. Analogously, for I = E,D, K, Q, R, S, 
define 

-(N) /(^) 

(3.20) /"^ = 

The following standard assumption is imposed on the sequences of fluid scaled 
external arrival processes {E^^'} and initial conditions Uo^\vo^^), N eN. 

Assumption 3. The following conditions are satisfied: 

(1) A^^-* ^ \ as N -^oo for some A G [0, oo), where A^^' X'^^^N; 

(2) As N ~>oo, E'^-* -^E in Vr^ [0, oo) F-a.s., where E{t) = Xt; 

(3) E[(l, r;^^^)] < oo anrf E[(l, ;/^^')] < oo /or each N eN. 

The following technical assumption was imposed on the hazard rate functions in 
[13] to establish the fluid limit theorem. 

Assumption 4. There exists < H'^ such that h^ is either hounded or lower- 
semicontinuous on {L^,H^), and likewise, there exists < such that h^ is 
either bounded or lower- semicontinuous on {L^,H^). 

We conclude with a mild assumption on the inter-arrival distribution function 

Assumption 5. The interarrival distribution has a density. 

3.2. Main Results. The first result focuses on the existence of a stationary dis- 
tribution for the state process. 

Theorem 3.2. For each N, under Assumption\^ the {Y^^\T^^^} is a Feller 
process that has a stationary distribution. 



The Feller property is proved in Proposition 14.21 and the existence of a stationary 
distribution is established in Theorem 221 In Theorem [7Tl the state process is also 
shown to be ergodic under an additional condition (Assumption |6l), which holds, for 
example, when the interarrival, reneging and service densities are strictly positive 
and the latter two have support on (0, oo). 

We now state the main result, which provides a first-order approximation for 
stationary distributions of iV-server queues. 

Theorem 3.3. Suppose Assumptionsl^{S[hold. Then given any sequence of scaled 
stationary distributions vj^^'/N = {a'"^l,x[ \vi^\rii'^^), iV G N, the sequence 

of marginals (x|, \T'i^\rii^'^) converges weakly, as N ^ oo, to the unique element 
in X\. 
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The proof of Theorem 13.31 which is given in Section [6l relies on a convenient rep- 
resentation of the mean dynamics of the many-server process (see Proposition [2TT]) 
to directly estabhsh convergence to the unique invariant state. In particular, the 
proof does not show that the fluid hmit converges, as i — > oo, to the unique in- 
variant state. Indeed, as discussed in Section [7.11 characterization of the long-time 
behavior of the fluid limit appears to be a non-trivial task. However, a generic 
example is provided in Section 17.21 to show that, when the invariant manifold has 
multiple states, the diagram in Figure [T] need not commute. The characterization 
of the stationary distribution, and investigation of the possible metastable behavior 
of the many-server queue in the presence of multiple states, remains a subject for 
future investigation. 



4. Stationary Distribution of the TV-Server Queue 

We now establish the existence of a stationary distribution for the Markovian 
state descriptor {Y}^\Tf^^} for the system with TV servers, under Assumption [5] 

First, in Section {Yf'^\ Tj:^^}t>o is shown to be a Feller process (see Propo- 
sition 14.21) . Then, in Section 14. 2[ the Krylov-Bogoliubov existence theorem (cf. 

Corollary 3.1.2 of [B]) is used to show that {y/^-*, J^j^^}t>o has a stationary dis- 
tribution. Finally, in Appendix \^ ergodicity and positive Harris recurrence of the 
process {y}'^\ Tj:^^}t>o is established under an additional condition (Assumption 
ID). For conciseness, in the rest of this section, N is fixed and the dependence on N 
is omitted from the notation. 



4.1. Feller Property. It follows from the definition of Y in (j2.2p and Lemma B.l 
of [14] that y is a so-called piecewise deterministic Markov process (see [12] for 
a precise definition) with jump times {ri, T2, . . .}, where each jump time is either 
the arrival time of a new customer, the time of a service completion, or the end of 
a patience time. Note that the set of jump times also includes the times of entry 
into service of customers since, due to the non-idling condition, each such entry 
time coincides with either the arrival time of that customer or the time of service 
completion of another customer. Let tq — 0. For each i G Y evolves in a 
deterministic fashion on [ri,Ti+i): 

y{t, + t) = 0Y(r,)(i), t e [0,Ti+i - n), 

where, for each y E y oi the form y — (a, x, J2i=i^n.i, Sj=i^zj)i k < N, we 
define 

(4.21) (l)yit)=la + t,x,Y,^n,+uJ2^^^+n^ ^^0. 

The Markovian semigroup of Y is defined in the usual way: for each t > 0, y € y 
and A e B{y), the set of Borel subsets of y, let 

(4.22) Pt(y, A) = F{Y{t) e A|y(0) = y). 

Moreover, for any measurable function ip defined on 3^ and t > 0, let Pfip be the 
function on y given by 



(4.23) 



PMy)^E[^{YmY{0)^y], yey. 
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We now show that the semigroup {Pt, i > 0} is FcUcr, i.e., we show that for any 
V' e Cbiy) and t > 0, PtV e C'biy). 

For each m € Z+, let Y"^ be the state descriptor of an N-sevvev queue with 
initial state 

\ i=l J=l / 

Suppose that {F™, m G Z+} are defined on the same probability space and y"^ 
converges to as m — )■ oo. The convergence of to ip implies that a;"* = 
x*^, fc™ = fc°, = /° for all sufficiently large m and, as m ^ oo, a™ — ^ a^, 
^ M° and ^ z° for each 1 < i < A:°, I < j <l°. Without loss of generahty, 
we may assume that x"* = k™ = k^, l"^ = for every m e Z+. For the mth 
A'^-scrvcr system, m G the time to the arrival of the first customer after time 
has distribution function F{a"^ + •)/(! — Fia^)), the distribution of the residual 
patience time of the initial customer associated with the point mass 5^^ has density 
and the distribution of the residual service time of the initial 
customer associated with the point mass has density + •)/(! ~ 

For simplicity, henceforth, we will denote A:'\/'\a;° simply by k,l,x. We assume 
that the elements of the sequence {F™, m G Z_|_} are coupled so that: 

• the inter-arrival times after the first arrival and the sequences of service 
times and patience times of customers that arrive after time are identical 
for each N-sevvei queue F™, m G Z+; 

• the first arrival time for the mth TV-server queue converges, as m — >■ oo, to 
the first arrival time for the 0th iV-server queue; 

• for each j = 1, - ■ ■ ,1, the remaining patience time of the customer associated 
with the point mass S^j^ converges, as to oo, to the remaining patience 
time of the customer associated with the point mass S^o; 

• for each i = 1, ■ ■ ■ ,k, the remaining service time of the customer associated 
with the point mass (5„m converges, as m — > oo, to the remaining service 
time of the customer associated with the point mass (5„o . 

Lemma 4.1. For each to G and n G N, let t™ he the nth jum,p tim,e ofY"^. 
Then for each n € N, r™ converges to and converges in y to Y'^{t^) 

U.S., as m ^ oo. 

Proof. We prove the lemma by an induction argument. First consider n = 1. For 
each m G Z+, the first jump time r™ is the minimum of the first arrival time of 
a new customer, the remaining patience times of initial customers with potential 
waiting times in the set {z^, 1 < i < and the remaining service times of initial 
customers associated with ages in the set {uf , 1 < « < A:}. It follows directly from 
the assumptions on {y™, to G Z+} that for every realization, 

(4.24) T-r^T?, asm^oo. 

Since the service time distribution function G" and the patience time distribution 
function have densities, with probability 1, r° coincides with exactly one of the 
following in the 0th system: the first arrival time of a new customer, the remaining 
patience time of an initial customer with initial waiting time 2^, 1 < J < ^, and 
the remaining service time of an initial customer with age u^, 1 < i < k. Let us 
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fix a realization such that equals the first arrival time of a new customer in the 
0th system. The remaining two cases can be handled similarly. In this case, by the 
convergence of t™ to r°, the convergence of the other quantities stated above and 
the coupling construction, for all sufficiently large m, r™ equals the first arrival 
time of a new customer. Hence, for all sufficiently large to, the first jump of is 
due to the first arrival of a new customer in the mth system. For such to, since Y"^ 
evolves in a deterministic fashion on [0,r™) described by the continuous function 
ip introduced in (|4.2ip . we have 

(fe I 
i=l j=l 

U k ^ N and x > k — N, then all the servers are busy and the customer that 
arrives at r™ will have to wait in queue. Thus 

^"(0- (o, x + J2^^T+-r+^o 
\ i=i i=i 

On the other hand, if fc < A^, then x — k and there is at least one idle server 
present. Hence, the customer will join service immediately upon arrival at time 
T™. Thus, in this case. 

In both cases, for the chosen realization, we have F'"(t{") — >■ y°(T°) as to oo. 

Now, suppose that r™ converges to and F'"(t™) converges to y°(T°) a.s., 
as TO — > oo, for 1 < i < n, and consider i = n + 1. Fix a realization such that 
T™ converges to r" and F"''(r™) converges to F°(r°) as to — oo. By the same 
argument as in the case n = 1, we may assume, without loss of generality, that for 
the chosen realization and to G Z_|-, the jump at r™ for is due to the arrival of 
a new customer. Then, for each m e Z+, y"'(r™) has the following representation: 

for some fc™, l^, 6 Z+, u™„, z™„ G R+ with < fc™ + 1^, fc™ < N. Due to the 
induction hypothesis and the topology of y, for all sufficiently large to, = , 
fc™ = fc° and Z,™ = and u™„ — >■ u°„ and z™„ as to — >■ oo for each 

1 < i < k^ and 1 < j < ^J^. The argument that was used for the case n — I can be 
again to show that tI^^^i converges to t^^^ and Y™{t^_^i) converges to Y°{T^^_^_l) 
a.s., as TO — >■ oo. This completes the induction argument and hence proves the 
lemma. □ 

Proposition 4.2. Suppose that the interarrival distribution F has a density. Then 
the semigroup {Pf, t > 0} is Feller. 

Proof. It is easy to see from the definition of the function Pti) in (I4.23P that when ij} 
is bounded, PtV' is also bounded. To prove the lemma, it suffices to show that Ptil} 
is a continuous function with respect to the topology on y. Fix t >0. Let y™ = 
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(a™, X™, /i™, TT™), m £ Z+, be a sequence of points in y such that y™ converges in 
3^, as TO — > cx), to j/*^, for some y° = (a°, 7r°) G y. Since Z+ is a discrete 

space and ^ as m ^ oo, it must be that for aU sufficiently large to, = x^. 
Without loss of generality, we assume that x™ — for each m G N. Consider a 
sequence of coupled A^-server queues {F™, m e Z+j such that F'"(0) = for 
each m e Z+. Then PtV'(y") = E[-0(y'"(t))]. To prove the continuity of Ptip, it 
suffices to show that Y"^{t) — > a.s., as to — cxo. Indeed, since € Cb(y), 

the latter convergence would imply that ip{Y"'-{t)) — > 'ilj{Y'^{t)) and hence, by the 
bounded convergence theorem, that Ptip{y"^) Pt'ip{y'^) as to cx), which would 
show that {Pt, t > 0} is Feller. 

It only remains to prove that Y"^{t) — s> Y^{t) a.s., as to — ?> oo. Since the 
interarrival distribution F, service distribution G" and patience distribution C all 
have densities, with probability 1, t does not belong to the set {t°, n G N} of jump 
times of Fix a realization such that t does not belong to the set {r", n G N} 
and such that for each n G N, t™ converges to and Y™{t™) converges in y to 
Y'^{tII), as to ^ cxd. By Lemma [4.1) this can be done on a set of probability one. 
Let r = sup{n : t° < t}. Then < t < T^_^_l, and hence for all sufficiently large 
m, T™ < t < T^i- By the convergence of F™(t™) to F°(t°), as to -> oo, and the 
definition of (t> in we conclude that Y'^{t) Y°{t), as TO — > oo. Thus, we 

have shown that Y™{t) — > a.s., as to ^> oo. □ 

4.2. Existence of Stationary Distributions. In this section, it is shown that 
the Feller process {Yt^ J-t}t>Q admits a stationary distribution. To achieve this, 
we use the Krylov-Bogoliubov theorem (cf. Corollary 3.1.2 of [5]), which requires 
showing that the following family {Lt, t > 0} of probability measures associated 
with {Yt,Tt}t>o is tight. For each measurable set B C y and t > 0, define 



t Jo 

Obviously, for each t > 0, Lt is a. probability measure on {y,B{y)). We now recall 
some useful criteria for tightness of a family of random measures. 

Proposition 4.3. A family {nt}t>o of AipiO, H) -valued random variables is tight 
if and only if the following two conditions hold: 

(1) supi>oE[(l,7rt)] < oo; 

(2) lim,^HSuptE[^t[c,iJ)] ^0. 

Lemma 4.4. We have supj>Q E[(l, 774)] < 00 and sup^Q E[(l, )] < 00. 

Proof. Let / = 1 in (|2.8p and (recalling that the superscript N is being suppressed 
from the notation) let e{t) = E [E{t)], t > 0. Using integration- by-parts, it follows 
that 
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Since is a renewal process with rate A, e(t)/t — 5- A as i — t- oo by the key renewal 
theorem. Moreover, the finite mean condition (|3.11|) implies t{l — G'''{t)) — > as 
t ^ oo. Therefore, we have sup(>ge(i)(l — G^{t)) < oo. The Blackwell renewal 
theorem (cf. Theorem 4.3 of [1 ) implies that e{t) ~ e{t ~ s) ^ sX as t ^ oo, and 
hence that sup^g /q (e(i) — e{t — s))g'^(s)ds < oo. Combining these relations with 
(3) of Assumption [3] and the last display, we conclude that supogE [(l,7yt)] < oo. 

On the other hand, since each i^t is the sum of at most N unit Dirac masses, it 
trivially follows that supog E [(1, j/t)] < < oo. □ 



To show that {rit}t>o and {^'t}t>o satisfy the second property in Proposition l4.3l 
note that by choosing / — l[c_^fr), c > 0, in (|2.8p . we obtain for < > 0, 



(4.25) E['qt[c.,H'')] < E 



, ^ , , l-G'-(a; + t) , 
l[c,H'-)(a; + t)— Tjoidx) 

[0,H'') 1 - O (X) 



Jo 



and, likewise, by choosing / = l[c,_ff=) in (12. 9p it follows that for t >0, 
(4.26) E[iyt[c,H^)] = E 



-E 



t,,^H^){t-.s){l-G\t-s))dK{s) 



We now establish two supporting lemmas. 
Lemma 4.5. We have 



(4.27) 

and 

(4.28) 



lim sup E 



lim sup 1 

C^H= t>g 



, , ^l-G^'ix + t) , , , 
a[c,H-)(a; + i)— j , , r]Q[dx) 

[0,^"-) i - Lr \X) 



l[c,//=)(a; + 0— j r<si \ Mdx) 

[O.H') i - (j [X) 



= 0. 



Proof. When < oo, we have 



supE 

t>o 



,l-G''{x + t) , , 
l[c,/f) (a; + t) — ?/o Kdx) 

.H'-) i - Ct [X) 



< sup] 

t>0 



= sup 1 
te[o,c) 



TLicM-){x + t)r]o{dx) 



l[c,H'-)(a; + Va{dx) 



V sup E 

te[c,H'-) 



l[c,_ff-)(2; + r]o{dx) 



It is easy to see from (3) of Assumption |3] that 



lim sup 

^^-f^" t£[c,H'' 



[o,Hn 



< lim E[77o[0,ff'' -c)] =0. 
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On the other hand, we know that 

/ %.H'-)ix + t)r]Q{dx) 
J[o,H'-) 



sup E 

te[o,c) 



< sup E[7]Q{c~t,H'' -t)] 
te[o,c) 



We show by contradiction that snpf^^Q ^^E,[riQ{c — t, H"^ ~ t)] as c — > H^. 
Suppose this is not true. Then there exist 5 > and sequences {c„}„gN and 
{^n}neN such that c„ as n — )■ oo, tn G [0, c„) for each n G N, and 

E [Vo{cn — tn, — tn)] > S for cach n e N. Since if < cxd, {t„}„gN is bounded and 
so we can take a subsequence, which we caU again {t„}„gN, such that hm„_^oo t„ = 
G [0,7?'']. In turn, this imphes 

hm E [7/o(c„ - t„, ii'' - tn)] 



hni E[r;o(i?'' -i*,ii''' -i*)] = 0, 



which contradicts the initial hypothesis. Thus, sup^^jQ ^-j E [rio{c — t, — t)] — > 0. 
Together with the last three displays, this implies that (|4.27p holds when < oo. 
On the other hand, when = oo we have 



supE 
t>o 



l[c,ff'-)(a: + 



1 - Cix + t) 



< sup E 
te[o,c/2) 



[0,! 



T^[c,oo}ix + 1) rjoidx) 



r]o{dx) 



< E[r;o(c/2,oo)] VE 



V sup E 

te[c/2,oo) 

l-G'{x + c/2) 



l-C'ix + t) 
3) l-G-{x) 



r]o{dx) 



[o.oo) l-G'-ix) 



Voidx) 



Sending c — > oo on both sides, and using the fact that E[(l, rjo)] < oo by Assumption 
131 an application of the dominated convergence theorem shows that the right-hand 
side vanishes, and thus (|4.27p holds in this case too. The proof of (|4.28p is exactly 
analogous, and is thus omitted. □ 

Lemma 4.6. Let e{t) = ^E{t)], t > 0. For {H,G) = ^G"") and {H,G) = 
{H^, G"*), we have 

ft 



(4.29) 



lim sup / TLif. H)it ~ s){^ ~ G{t — s)) de{s) 



0. 



Proof. E is a. (delayed) renewal process with rate A and due to Assumption [l] the 
function x ^ l[c,//) (a;)(l — G{x)) is directly Riemann integrable. Thus, by the key 
renewal theorem, we obtain 



lim 



^[c,H){t ~ s){l ~ G{t - s)) de{s) = ^ 



^[cM){x){l~G{x))dx. 



Since the integrability condition imposed in Assumption[l]implies that Jj^ 
G{x)) da; -> as c ^> iJ, we have the desired result. 



■■M){x){l- 
□ 



Lemma 4.7. The family {r/tjoo of A4f[0, H^) -valued random variables and the 
family {i't}t>o of A4f[0, H^)-valued random variables are tight. 



Proof. Both families satisfy the first condition of Proposition 14.31 due to Lemma 
4:41 Combining (|4:25| with (j4:27| and Lemma EH for the case {H, G) = (^^^ C), 
it follows that {?7t}t>o also satisfies the second condition of Proposition 14.31 and is 
thus tight. 
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It only remains to show that {j^t}t>o also satisfies the second condition of Propo- 
sition 231 for which it suffices to show that, as c — > , the supremum of the 
right-hand side of (|4.26l) goes to zero. Now, let k{t) = E[i4r(t)] for t > 0. Applying 
the integration-by-parts and change of variable formulas on the second term on the 
right hand side of (|4.26p . we see that 
(4.30) 



supE 



\^,,H^){t-s){l-G'{t-s))dK{s) 

sup j \{,^H^){t-s){l^G'{t^s))dk{s) 
sup,>° {k{t - c)(l - G'{c)) - k{{t ~ HT){1 - G{{t - HT) 
k{t - s)g''{s)ds 



< sup lk{t - c)(l - G'{t)) + [ {k{t - c) - k{t - s)).g"(s) ds] . 

t>c y Jc J 

By taking expectations on both sides of (|2.7p . we have for each t > 0, 

E [Q(0)] + e(<) ^ E [Q{t)] + E [R{t)] + k{t). 
Since Q and R are non-negative and R is increasing, it follows that 

k(t-c) < e(t-c)+E[Q{0)] 

and 

k{t - c) - k{t -s) < e{t - c) - e{t - s) + {E [Q{t - s)] - E [Q{t - c)]). 

Combining these inequalities and carrying out another integration- by-parts, we 

obtain 

(4.31) 

sup / l[,^Hs){t-s){l-G'{t-s))dk{s) 

t>c Jo ^ 

<sup / l[c,H=)(i-s)(l-G"'(t-s))de(s)-|-supE[Q(0)](l-G"'(i)) 

t>0 Jo ' t>c 

+ sup / {E[Q{t-s)]-E[Q{t^c)])g''{s))ds. 

t>c Jc 

Applying Lemma with {H, G) — (i/*, G*), we have 

lim sup / l,^H-)it~ s){l-G%t- s))de{s) =0. 

c^H- t>o Jo 

Moreover, 

lim supE [Q(0)] (1 - G^t)) = E [Q(0)] lim (1 - G'(c)) = 0. 

c^H= t>c c^H' 

Also, since Q[t) < by (12. 6|) . we have 

sup / (E[Q(<-s)]-E[Q(i-c)])g"(s))ds<2supE[(l,7/t)](l-G*(c)). 

t>c Jc t>0 

Since Lemma l44l implies supj>Q E[(l, ryt)] < oo, the right-hand side of the above 
inequality tends to zero as c ^ H". Combining the last five assertions with (|4.30p 
and (|4.3ip it follows that as c — > " , the supremum over t > of the second term 
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on the right-hand side of ()4.26p vanishes to zero. On the other hand, as c H'^ , 
the supremum over t > Q oi the first term on the right-hand side of ()4.26p also 
vanishes to zero by (|4.28|) . Thus, we have shown that supj>Q E [z^f [c, iJ*)] — > as 
c H'^, and the proof of the lemma is complete. □ 

Lemma 4.8. The family of probability measures {Lt}t>o is tight. 

Proof. By Lemma HTTl we know that for each (5 > 0, there exist two compact subsets 
Cs C 7WF[0,i?") and Ds C Mf[(),H'') such that 

(4.32) 

It follows from and (gS]) that X{t) < (1, i^t) + (1, Vt) for each t > 0. Together 
with (j4.32p and the fact that the map /i — > (1, /i) is continuous, we know that there 
exists 5 > such that 

(4.33) inf P {X{t) <b)>l-6. 

On the other hand, by Theorem 4.5 of [T], it follows that asit) converges weakly, 
as t — >■ oo, to the distribution 

(4.34) Fo{t) = \ [\l - F{y))dy. 

Jo 

Thus, there exist Tg > and c > such that for all t > Tq, 

Fiasit) <a)> ¥{Fo <a) -d/2>l-d. 
By choosing a large enough, we may assume, without loss of generality, that 

inf F(aE(t) < a) > 1 - S. 

Define Cg = [0, a] x [0, b] x Cg x Ds- Then the set Cs is compact and Lt{Cs) >l — 5 
for each t >0, which proves the lemma. □ 

Since {Yt,Ft}t>o is a Feller process by Proposition 14. 2[ the Krylov-Bogoliubov 
theorem and Lemma 14.81 immediatelv yield the following result. 

Theorem 4.9. Suppose that Assumption\^holds. Then the state descriptor (q!_b, X, rf) 
has a stationary distribution. 



5. Fluid limit 

In Section 15.11 we describe a deterministic dynamical system that was shown 
in Theorems 3.5 and 3.6 of 14^ to arise as the so-called fluid limit of a many- 
server queue with abandonment that has service time and patience time distribution 
functions G"* and G"", respectively. In Section r5.21 we identify the invariant manifold 
associated with the fluid limit, which is subsequently used to obtain a first order 
asymptotic approximation to the stationary distribution of the fluid scaled state 

descriptor Y^^\ 
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5.1. Fluid Equations. The state of the fluid system at time t is represented by 
the triplet 



Here, X{t) represents the mass (or, equivalently, limiting scaled number of cus- 
tomers) in the system at time t, 77t[0,a:) represents the mass of customers in service 
at time t who have been in service for less than x units of time, while ^j[0, x) repre- 
sents the mass of customers in the system who, at time t, have been in the system 
no more than x units of time and whose patience time exceeds x. The inputs to the 
system are the (limiting) cumulative arrival process E, and the initial conditions 
X(0), Vq and tjq. Thus, (l,I^o) represents the total mass of customers in service at 
time 0, and the fluid analog of the non- idling condition (|2.4p is 



The quantity (1, ?7q) represents the total mass of customers at time whose residual 
patience times are positive. Hence, we have 



where recall that Ir^ [0, oo) is the subset of non-decreasing functions / £ [0, oo) 
with /(O) = 0. Let F^*(2;) denote r]^[0, x] for each x G [0, H''). 

Definition 5.1. (Fluid Equations) Given any (i?,X(0),Fo,77g) S Sq, we say 
that the cadlag function {X,17,r]) taking values in M+ x AiFlOjH") x Mf[0,H^) 
satisfies the associated fluid equations if for every t e [0, oo). 



(5.35) 



l-(l,I7o) = [1-X{0) 



+ 




(5.37) 




for every bounded Borel measurable function / defined on M-|_, 



(5.38) 




and 



(5.39) 




where 



(5.40) 



K{t) 



[X{0) 1] 



+ 



[X{t) -1]+ + E{t) - R{t); 



(5.42) 



(5.41) 
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(5.43) 1-(1,T7,) ^ [1-X(<)] + ; 

(5.44) [X(t)-l]+< (1,^,). 

Note that the fluid equations defined above are equivalent to the fluid equations 
in Definition 3.3 of [H] (although (3.40) and (3.42) of [13], which are the analogs 
of (|5.38p and (|5.39p . were only required to be satisfied for continuous functions 
with compact support in |14) . a standard monotone convergence argument shows 
that they are equivalent to (j5.38p and (I5.39|) here). Under some mild assumptions 
on the input data E, Fq, t^q, and the hazard rate functions and h'^ (stated in 
Assumptions [3] and HI, Theorems 3.5 and 3.6 of [14] established that there exists a 
unique solution to the fluid equations, 

For future purposes, note that if {X,17,t]) satisfy the fluid equations for some 
(S, X(0),I7o,r7o) e So and K satisfies (|5.40|) . then K also satisfies 

(5.45) K{t) - {l,Vt) - (l,I7o) + / {h\Vs)ds. 

Jo 

Indeed, this follows from (|5.40[) . (|5.4ip and ()5.43|) . Moreover, combining ()5.45|) and 
(|5.38p . with / = 1, and using an integration- by-parts argument (see Corollary 4.2 
of [14]) it is easy to see that K satisfies the renewal equation: 

(5.46) Kit) = (l,T7,)-(l,T7o)+ / ^l^lll-^Mvoidx) 



[0,^.) 1-G^{x) 



+ / g'it^ s)K{s)ds. 





Since the first two terms on the right-hand side are bounded, by the key renewal 
theorem (see, e.g. Theorem 4.3 in Chapter V of [1 ), this implies that K admits the 
representation 
(5.47) 

K(t) = (1, vt) ~ (1, vq) + / — — vo(dx) 




\ /-i-\^f G^ix + t-s)-G^ix) _ ^\ 
1, vt-s) - (1, 1^0) + / z 77rr~\ i^oidx) u (s) ds, 



lo 



[o.H^) l-G^(x) 



where u'* is the density of the renewal function U'^ associated with G"* (u* exists 
since C is assumed to have a density). Also, it will prove convenient to introduce 
the fluid queue length process Q, deflned by 

(5.48) Q{t) = [X{t) - 1] + , te[0,oo). 
Then, the inequality in ()5.44|) implies 

(5.49) Q{t) < (1,77,). 

Observe that (|5.40[) and (|5.48p . when combined, show that for every t G [0, oo), 

(5.50) Q{0) + E{t) = Q{t) + K{t)+R{t). 

We can also deflne the fluid equations without abandonment. Let 

(5.51) So = {{e,x,i^) 6Ir+[0,oo) x M+ x Mf[0,H'') ■.1-{1,u) = [1 -a;] + } . 
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Definition 5.2. Given any {E,X{0),Vo) G Sq, we say {X,V) e R+ x Mf[0,H'') 
is a solution to the associated fluid equations in the absence of abandonment if 
for every t G [0,oo), the second inequality in (I5.37|) holds, equations (I5.38|) . (|5.40l) . 
([QT]) and ((5^ hold with R = 0. 

Remark 5.3. The case when customers do not renege corresponds to the case 
when the patience time distribution has all its mass at oo. Formally setting 
dC = doo in Definition 15.11 we obtain the fluid limit equations in the absence of 
abandonment specified in Definition 15.21 (also refer to Definition 3.3 of [15]). In 
fact, in this case, G'^{x) — and hence h'^{x) — for all x G [0, oo). From this 
and we can see that R{t) = for all t > 0. Moreover, ((07| . ([08)) . ((OT1) . 

([g^ and ((05|) are equivalent to (3.4)-(3.8) of Definition 3.3 of ll5j. At last, by 
letting / = 1 in (I5.39p . since G"" is zero on [0, oo), we have (l,?7t) = (1,%) + E{t). 
On the other hand, by (|5.41|) and ()5.36|) . we have 

[X(t)-1]+ < [[X(0)-1]++E(t)] + 

Thus, [X{t) ~ 1]+ < (l,77t) shows that (|5.44p holds automatically when there is no 
abandonment. 

5.2. Invariant Manifold. We now introduce a set of states associated with the 
fluid equations described in Definition 15.11 which we call the invariant mani- 
fold. As shown in Section [6l when the invariant manifold consists of a single 
point, it is the limit of the scaled sequence of convergent stationary distributions 
(xi"\l7W,ryl-)) = i(xW,.P),,f)). 

Definition 5.4. (Invariant Manifold) Given A G (0,oo), a state (xq, t'o, ?yo) S 
R+ X Mf[0, H") X Mf[0, H'') with [l-a;o]+ = l-(l,z/o) and [2:0-1]+ < (l,?7o) is 
said to be invariant for the fluid equations described in Definition 15.11 with arrival 
rate A if the solution {X,T7,rj) to the fluid equations associated with the input 
data (Al, xo, j^Oj ^70) satisfies {X{t),T't,rjt) = {xo,iyo,r]o) for all i > 0. The set of all 
invariant states for the fiuid equation with rate A will be referred to as the invariant 
manifold (associated with the fluid equations with rate A). 

Theorem 5.5. (Characterization of the Invariant Manifold) Given A G 
(0, cx)), the set X\ defined in 13.16\) is the invariant manifold associated with the 
fluid equations with rate A. 

Theorem 15.51 is a consequence of the next two lemmas. Let A G (0, 00) and 
(xq, t'o, ?7o) be an invariant state according to Definition 15.41 Then the solution 
(X,I7, ?7) to the fluid equations associated with the input data (Al, xq, t'o, ?7o) G Sq 
satisfies {X{t),T7t,r]f) — {xo,i^o,i]o) for all t > 0. Let Q, R, K be the associated 
auxiliary processes satisfying (I5.48p . (|5.42p . (|5.40p . and recall the definition of the 
measures z^* and 77* given in p.l3p and p.l4p . respectively. 

Lemma 5.6. // (xo, vt), tjq) is an invariant state, then r]Q{dx) — A(l — G^{x))dx = 
\r]^,{dx). 
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Proof. On substituting the relation rjt — rjQ, t>Q, into ()5.39p . we see that for every 

/ e Cfc(M+) and t e [0,oo), 
(5.52) 

loM'-) Jlo,H'-) l-G'^{x) Jq 

Sending t oo and applying the dominated convergence theorem, we obtain 

/ fix) rjoidx) r - G'^(s)) ds^ [ /(s)A(l - G'-(.s)) ds. 

J[G,H^) Jo J[QM'') 

It then follows that rj^idx) = \rj<,{dx). □ 

Lemma 5.7. If (xa,i>Q,r]o) is an invariant state, then i^oidx) = (A A and 
xq = X if X < 1 and xq e Bx if X > I. Moreover, (xq , i^* , 77* ) is an invariant state 
if xq ~ X < 1 or X > I and xq e B\ . 

Proof. Suppose {xo,uo,rio) is an invariant state. Since X{t) ~ xq, we have Q{t) — 
Q{0) by (|5.48p . Since, in addition, rj^ — rjo — Xrj^ by Lemma we have 

l-iX{t)-l]+ _ rl^o-i]+ , 

/ h^{F^') {y)dy^ / h^{F^^') {y)dy. 

Jo Jo 

Let p denote the term on the right-hand side of the above display. Then for each 
i > 0, by ([CT^ . we have R{t) = pt and, by ((53(I1) . we have K{t) = (A - p)t. 
Substituting Vt = in (15.38^ . we obtain for every / G C6(R+) and t e [0, 00), 
(5.53) 

fix) Mdx) = [ /(-^+^)^T^^^^ f fm-G%s)){X-p) ds. 

By letting t ^ 00 and applying the dominated convergence theorem, we obtain 

fix) Mdx) = {X-p) f f{s){l-G%s)) ds - (X-p) f f{s){l-G%s)) ds. 

[0,ff=) "'0 J[0,H'-) 

Thus voidx) = (A — p)v^:{dx), and so (1, vq) = X — p. 

To show that i'o{dx) = (A A l)z^»((ix), it suffices to show that A — p = (1, i^o) = 
A A 1. If a;o 1: then p = by its definition. Hence, Voidx) = Xv,,{dx) and 
A — (1, vq) < 1. Thus, in this case, A — p = A A 1. On the other hand, if xq > 1, it 
follows from (15.43^ that (1, i^o) = 1- Since we also have (1, t'o) = X — p, it follows 
that A = p + 1 > 1. Thus, in this case too, we have A — p = A A 1. This proves the 
first assertion of the lemma. 

For the second assertion of the lemma, we observe that when A < 1, the equality 
X—p~ A A 1 implies p = and (1, ^'o) = A < 1. Hence (|5.35p implies xq — (1, vq) — 
X. If A > 1, we have i'Q{dx) = v<,{dx) and the equality A — p = A A 1 implies 
p = A — 1. Then xo > (1, vo) = 1 and 

XG^({F^^')-\{x^-l)+))= j^J" h^{{F^^')-\y))dy^p = X-l. 

Hence xq belongs to the set B\ defined in (|3.15p . The last assertion can be verified 
directly by substituting the initial condition into the fluid equations. This completes 
the proof of the lemma. □ 
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6. The Limit of Scaled Stationary Distributions 



This section is devoted to the proof of Theorem 13.31 Due to Theorem 14.91 
under Assumption [SJ there exists a sequence of 3^- valued random variables Y^J^'^ = 
(a^^l,X^, ,X/1^\ Tyl^''), iV e N, where the distribution of is stationary for the 
dynamics of the fluid-scaled A'^-server queue with abandonment (note that we do 
not require the stationary distribution of the A^-server system to be unique here). 
Let (x*, (A A 1);^*, A77,) be the unique element of the invariant manifold Ia- The 
main result of this section is to show that, under Assumptions [THll as A^ — 00, 

(6.54) (Xf\T7W,7yl^') ^ (a;„(AAl)i/„A77*). 

In order to prove this result, we first show in Section 16.11 that the sequence 

{(x[^\v'-J^\rj'-J^^), Af G N} is tight. Then, in Section [621 we prove (l634ll by 
showing that the weak limit of every convergent subsequence must be an invariant 
state and using the fact that there is a unique invariant state. For both these 
results, for each A^ S N, we will find it convenient to define 



(6.55) 



Y 



{N) 



to be the fluid-scaled process for the A^-server queue with abandonment associated 
with the initial condition Y^'^\o) = (E^'^\xi^\vi^\fii'^'>), where E^^^ is the 
fluid scaled stationary renewal process determined from the backward recurrence 



time process Q?^'' with initial distribution a^'j. Let Q^'', R 



(N) 



K^^^ be the 



associated fluid-scaled auxiliary processes described in Section [22 



6.1. Tightness. Recall the criteria for tightness of measure-valued random vari- 
ables in Proposition [4?3l 



Lemma 6.1. Let c e [0,H^'). For each integer n > 2, 77 
following relations: 
(6.56) 



and 



satisfy the 



E 



1}^ 



E 



1-G"'(a; 



+ E 


/ 




^0 



E 

i=2 



(1-G^(jc 



s))dE^^\s) 



3.57) 



E 



Fl^)[c,i/^) 



^ E 



l-GHx 



+ E 


/ 




JO 



E 

i=2 



(1- 



G'{3c-s))dK^^\s) 



Proof. We only prove (j6.56p since (16. 57^ can be proved in the same way. Fix 
c e [0,i7''). Dividing both sides of ([! 
for each bounded measurable function / on R+ and t > 



by A^ and setting tiq^"^ — rii^\ we obtain 



(6.58) 



E 



E 



+E 



[O.H'- 
t 



fix + t) 



l-G-(. + t) _(.)^^^^ 



1-G"^(x) 



fit-s)il-G^it-s))dE' '{s) 
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Since the initial conditions are stationary, rj[^^ has the same distribution as ^1^' 
for every i > 0. Therefore, by substituting / — Ifcif) and t = c in (|6.58l) . and 
noting that \\^^ u^-^{x + c) = 1 for every a; > and 1[c,h'-)(c — s) =0 for every 
s e [0, c], we obtain 



E 



E 



l-G"'{x + c)_, 



Next, by choosing / = (1 - G"'(- + c))/(l - G"'(-)) and i = c in we obtain 



E 



l-G'-(a; + c)_, 



E 



-E 



(l-G'-(2c-s))d^^^\s) 



By combining the last two displays, we see that 



-E 



(1 -G'^(2c-s))d^^^^(s) 



Thus, we have shown that (|6.56p holds for n — 2. Suppose that for some integer 
TO > 2, (|6.56l) holds for n = m, i.e.. 



(6.59) E[r7l'^)[c,i/'^)] 



E 



-E 



[o,Hn i-G'^(x) 

fC ™ 



By choosing / = (1 - G''(- + toc))/(1 - G''(-)) and i = c in and using the 



fact that rji^^ has the same distribution as rjY" ' , we obtain 
E 



[o,//-) 1 - G' (.t) 



(6.60) 



l-G*^ a; + TOc) _(jv) 
lo,H'') l-G'^(x) 

l-G'-(a: + (TO + l)c) w 
[o,_f/'-) l-G'^(x) 

{1 - + l)c - s))dE^^\s) 



This, together with (|6.59p . yields (|6.56p with n = m + 1. This completes the 
induction argument and we have the desired result. □ 



Theorem 6.2. The sequence {{x[^ \i^i^\'ri*^^)}Nefi tight. 
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Proof. We first show that {?7* }ArgN is tight. Note that (l,ry(^^) can be viewed 
as the fluid scaled queue length process associated with an infinite-server queue 
with arrival process E''" and service distribution function C. By Little's Law (cf. 



|17)). we know that £[(1,77*™-')] = x'^^^B'^, where 6^, defined in Assumption [1] is 

the mean of C. Due to the convergence of A^^^ to A stated in Assumption [31 this 
implies 



3.61) 



sup E 

N<£N 



< 00, 



which establishes the first criterion for tightness. 

Next, for each n, the function (1 — G"'(- + nc))/(l — G""(-)) is bounded by 1 and 
converges to as n —> 00, an application of the dominated convergence theorem 
shows that 



(6.62) 



lim E 



IQ,H^) t ~ (-f (X) 



= 0. 



Sending n — 00 on the right-hand side of (|6.56p , and using (|6.62p and the monotone 
convergence theorem, we have 



3.63) 



On the other hand, we also have the simple estimate 
(6.64) E 



{l~G''{2c-s))dE^^\s) 



< {l~G^{c))E[E^''\c)] 



c{l~G^{c)) 



E[E^''\c)] 



By carrying out an integration by parts on /o°°(l ~ G^{x))dx, it follows that 



[0,/f 



{1 - G"^ (x)) dx ^ lim x{l-G''{x)) + 



xeH'- 



xg^{x) dx. 



However, since the mean 9"^ is finite by p. Ill) , it follows that c(l — G''(c)) as 
c — . In addition, since W[E'^^\c)\/c — > A*'^'', as c 00, by the elementary 
renewal theorem and A ^ A as — > cxd by Assumption |3|l), it follows that 



(6.65) 



hmsupsup— < CO. 



Thus, taking the supremum over N and then c in (|6.64p . we obtain 



(6.66) 



lim supE 



\l-G'-{2c~s))dE^^\s) 



^ 0. 



Since 1 — G^{-) is a decreasing function, for s G [0, c]. 



00 „ 
^c(l-G^(jc-.))< / (1 

j=3 J[2c-sM-) 



- G''{x))dx < 



[c,Hn 



{l-G''{x))dx. 
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Therefore, we have 



supE 

N 



3=3 



A' C Jlc,H'') 



which tends to zero, as c — >■ H^, because of (I6.65p . By combming the last assertion 
with (|6.63p and (|6.66p . we see that 



3.67) hm supE l)i^\c,H'') 



0, 



which estabhshes the second criterion for tightness. Thus, the sequence {»7l^''}7veN 
is tight. 

We next show that {^'I^^'Iatgn is tight. The anafog of (|6.61l) holds for {Fl^-'jjvgN 
automatically since < 1 for each N. On the other hand, the analog of 

()6.67p can be shown to hold for {fI^'Ijvgn by using (|6.57l ) and an argument similar 
to that used above to establish (j6.67p . along with the additional observation that 

E[7?^^\c)] < ¥.\e''-^\c)] +E[(l,77l^')] implies limsup,^^. supjv E[i?*^^(c)]/c < 
oo. Thus {Fl''^'}ArgN is tight. 

Finally, we show that the sequence of R-|--valued random variables {X^ Iatgn is 
tight. Since Xl^^ < l + (l,77l^^) for each iV, supjvE[Xi^^] < 1 + supjv E[(l, ^1^^)], 

which is finite due to (|6.6ip . The tightness of {X^^''}ArgN is a direct consequence 
of Markov's inequality. □ 

6.2. Convergence. Let {{X^^\T'^J^\rfJ^'^)}Me.'H be any sequence of (marginals) 



of the scaled stationary distributions, which was shown to be tight in Section [Ol 
In this section we establish the convergence (|6.54l) by showing that any convergent 
subsequence must have the invariant state as its limit, and then invoke uniqueness 
of the invariant state. 

Lemma 6.3. The sequence {^I^'^Iagn converges weakly to Xrj^: as N ^ oo. 

Proof. Since the sequence {{x[^\T'i^\rji^^)}]\j(zf!i is tight by Theorem 16.21 there 
exists a convergent subsequence which, by some abuse of notation, we denote again 
by {{X^^\vi^\rji^^)}N(zfi. Let {X.^,, v^,,f}^,) be the corresponding limit. Due to the 
Skorokhod representation theorem, without loss of generality, we may assume that 
{X^^\T'^^\rfJ^^) converges almost surely, as cx), to (X* , , ry* ) . Together 

with Assumption 121 this implies that Assumption 3.1 of [Tl] holds. For each G N, 

consider the fluid-scaled process ' in (I635|) . Since Assumption 3.1 of [14 holds 
for {^''^''ijvgN and Assumption 2] is also satisfied, the hypotheses of Theorems 6.1 
and 7.1 of jl4j are satisfied. Thus, we can conclude that the sequence {^^^•'}jveN 
is tight and any weak limit, denoted by 77, satisfies (3.42) of [2] with fj = fj and 
Vo — V*- (Note that Assumption 3.2 of [14] is not used in Theorem 7.1 of [14] to 
prove (3.42).) Therefore, it follows from Theorem 4.1 of [15] that for / e Cb(M+) 
and t > 0, 

(6.68) {f,fjt)= [ f{x W^ ^^rr^!^ ~ri*{dx)+ f !{t^s){l~G^{t~s))\ds. 
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Since, for each t > 0, Tj\^^ and ryl^-* have the same distribution, f)t and 77, must also 
have the same distribution. If we restrict the two measures fjt and 77* to [0,t], then 
those two restricted measures again have the same distribution. By substituting 
/ = l[o.t] (I6.68p . we can easily see that measure f)t, restricted to [0,t], is the 
same as Al[o (a;)(l — G"'(a;))c?a::. Thus, the measures 77* and A77*, restricted to [0,i], 

also coincide. Thus, fj^ — Xri^,. This shows that {77!^'} converges weakly to A7;, , as 
iV -^■ 00. □ 

Proof of Theorem 13.31 Since the sequence {(X^^\v^J^\rii^J^^)} N^f^ is tight 
by Theorem 16.21 there exists a convergent subsequence which, by some abuse of 

notation, we denote again by {{x\ 77l^\ 7yl^'')}AreN- Let (X*,i>*,77*) be the 
corresponding limit. Due to the Skorokhod representation theorem, without loss 

of generality, we may assume that j/l^-*, tjI^-*) converges almost surely to 

(X*, 77*). For each TV € N, consider the fluid-scaled process y^^'' in (|6.55p . It 

follows from Assumption [3] that the initial condition {Y'^^''(0)}ArgN satisfies As- 
sumption 3.1 of [14] holds. By Lemma [6.31 and the fact that E{t) = \t, the initial 

condition {Y (0), N & N} also satisfies Assumption 3.2 of [M]. By Assumption 

|3]and Theorem 3.6 of [Tl|, it then follows that {X converges weakly, 

as iV ^ 00, to the unique solution (X,I7, r/) of the fiuid equations defined in Def- 
inition [^31 associated with the initial condition (X*, r),). By the stationarity 
of {X^ ,vi^\rji^^) for each N, it follows that (X*,!^*,??*) is an invariant state of 
the fluid limit {X,V,r]). Therefore ( A"* , i/* , 77* ) belongs to the invariant manifold. 
Since the invariant manifold has a single element by Assumption [5J the usual ar- 
gument by contradiction shows that {X^ , f', , 77, ) is in fact the limit of the sequence 

7. Concluding Remarks 

We can establish ergodicity of the state processes, under an additional condition. 
Let 

= sup{w e [0, H^) : = a.e. on [a, a + u] for some a G [0, 00)} 

and 

= sup{u G [0, H'^) : = a.e. on [a, a + u] for some a e [0, 00)}. 

Assumption 6. The following three conditions hold: 

(1) H-" = H' = 00; 

(2) V < 00; 

(3) For every interval [a, b] C [0, 00) with b-a>0, - F^^^a) > 0. 

Theorem 7.1. The Markov process {Yt^J-'t} is ergodic in the sense that it has 
a unique stationary distribution, and the distribution of Y{t) converges in total 
variation, as t ^ 00, to this unique stationary distribution. 



Theorem 17.11 whose proof is deferred to the Appendix, validates the rightward 
arrow on the top of the "interchange of limits" diagram presented in Figure [TJ On 
the other hand, the fluid limit theorem (Theorem 3.6 of [13]) justifies the down- 
ward arrow on the left-hand side of Figure [TJ The focus of this work has been on 
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Figure 1 . Interchange of Limits Diagram 



understanding the convergence represented by the downward arrow on the right- 
hand side of Figure [T] When there is a unique invariant state, this convergence 
is estabhshed in Theorem 13.31 Although this question is not directly relevant to 
the characterization of the stationary distributions, it is natural, in this setting, to 
ask whether the diagram in Figure [1] commutes, namely, whether the fluid limit 
from any initial condition converges, as i oo, to the unique invariant state. In 
Section 17.11 we briefly discuss why the study of the long-time behavior of the fluid 
limit is a non-trivial task. Furthermore, in Section 17.21 we provide a very simple 
counterexample that shows that the diagram in Figure [1] need not commute and 
thus the limits N oo and t — > oo cannot always be interchanged. 

7.1. Long-time behavior of the fluid limit. The long-time behavior of the 
fluid limit is non-trivial even in the absence of abandonment. For example, in the 
absence of abandonment, it was proved in Theorem 3.9 of [TS] that when the service 
time distribution G"* has a second moment and its hazard rate function ft,* is either 
bounded or lower-semicontinuous on (toq, H^) for some mo < H", Vt (A A 1):^* as 
t oo. The question of whether the second moment condition on the distribution 
is necessary for this convergence is still unresolved. Even under the second moment 
assumption, the long-time behavior of the component X of the fluid limit is not 
easy to describe except in the cases when the system is subcritical (A < 1) or 
when the system critical or supercritical (A > 1) and the service distribution is 
exponential. In the former case, it follows from Theorem 3.9 of [TS] that X{t) 
A(l, ly^,) as t — oo, while in the latter case, if the initial condition satisfies X{0) > 1 
and Vq G A^i?[0,oo), then it is easy to see that the fluid limit is given explicitly 
by X{t) = X{0) + (A - l)t and Vt{dx) = l[o^f]e-^da; + l^t,oo){x)e-*Vo{d{x - t)). 
Therefore, at criticality (A = 1), if X(0) = 1 then X{t) = X(0) for every t > 0. In 
particular, X{t) — > 1 as t — oo. However, as the following example demonstrates, 
the critical fluid limit need not converge to 1 (even if starting critically loaded) 
when the service is non-exponential. 

Example 7.2. Let the fluid arrival rate be E{t) — t, t > 0, and let the service 
time distribution G" be the Erlang distribution with density 



A simple calculation shows that /o°°(l — C{x)) dx — 1. Let (AT, 77) be the solution 
to the fluid equations without abandonment (see Definition l5.2p associated with the 
initial condition (1,1, (5o). We show below that in this case, limt_>oo A(i) = 5/4, 
which is bigger than 1 = A(0). In fact, since Vq — 6o, a straightforward calculation 
shows that 



g^ix) = Axe 



, x>0. 
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Define 

K = inf{t > : {h\Vt) > 1}. 

Then, since is continuous, k > and for t G [0, k), {h'^^vt) < A = 1. Hence, 
(l,Ft) 1 for eacli t e [0, n) and dK / dt{t) ^ {h'',Vt). For eacli t e [0, k), 

{h\Vt) ^ g''{t)+ [ g^it ^ s)dK/dt{s)ds ^ g%t) + [ g^it - s){h%Vs)ds. 
Jo Jo 

By tlie key renewal tlieorem, we liave 

(/i^77t)=^.^(^) = l-e-4*. 

Since u'^{t) < 1 for all i > 0, we must have that k = oo, {l,i^t) = 1 for all t > 0, 
and 

/•oo /"OO 

lim Q{t) ^ (1 - u%t))dt = / e-'^^dt = 1/4, 
t-^°° Jo Jo 

which yields the convergence of X{t) to 5/4 as t oo. 

To emphasize that this phenomenon is not an artefact of the fact that the initial 

condition was chosen to be singular with respect to Lebesgue measure, we show 

that we can modify the above example by choosing Vq to be absolutely continuous 

with respect to the Lebesgue measure. For example, for some a £ (0, oo), define 

qf^) = l^ ifa:£[0,a], 
\ otherwise , 

and let T'o{dx) = q[x)dx. Then (1, Fo) = J^" q{x)dx = 1, {h'^ ^ut) = 1 — ((1 — a)/(a + 
l))e~^* for each t>Q. Hence, when a < 1, we have {h^ ,vt) < 1 and (1, i^t) = 1 for 
alH > 0. This implies that, when a < 1, 

lim Q{t) ^ / ^e-^'dt = ^ > 0, 

t^oo^^' 7o a + 1 4(a + l) 

showing that limt^.oo X(t) > 1. 

7.2. A Counterexample (Invalidity of the Interchange of Limits). In this 
section we show that, even for an M/M/N queue (both with and without aban- 
donments), an "interchange of limits" need not hold, i.e., the diagram presented in 
Figure [1] may not commute. 

Consider the sequence of state processes {X^^\i'^-^^), N &N, of A^-server queues 
without abandonment, where the service time distribution G** is exponential with 
rate 1. For the A^-th queue, let the arrival process E'^^'> be a Poisson process 
with parameter A'^-* = A'^ — 1 and suppose that there exists Vq G A^i?[0,oo) with 
(1- i^o) < 1 such that a.s., as ^> oo, 

(7.69) (X^'^\0),Ff))^(2,I7o). 

Given the exponentiality of the service time distribution, it immediately follows 

that Assumption 2 of [TS] is satisfied. Moreover, since (j7.69p holds and A^^'' = 
{N — 1)/A^— >lasAf— >-oo, it follows that Assumption 1 of |T5] also holds with 
A = 1. On the other hand, since G'"(x) = for all x G [0,oo), Assumption 2 
fails to hold because in this case Bi — [0, oo) and so the invariant manifold has 
uncountably many points. 

Now, since Assumptions 1 and 2 of [H] ensure that the conditions of the fluid 
limit result. Theorem 3.7 of [15], are satisfied, it follows that, N — >■ oo, 
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(x'^^f'^') converges weakly to the unique solution {X,V) of the fluid equations 
associated with (1, 2,77o), and, using the exponentiality of the service time distribu- 
tion, it is easily verified that the fluid limit is given explicitly by X{t) = X{0) = 2 
and Vt{dx) = l[o,t]e~^da; + l(^t,oo){x)e~*Vo{d{x - t)). 

For each N €N, since the arrival rate, which equals iV — 1, is less than the total 
service rate iV, by (3.2.4) and (3.2.5) of [4], it follows that X'^^'> is ergodic and has 
the following stationary distribution: 

(TV - f)'= 



Po if fc = 0,l,...,iV 

Po iik^N,N + l, 



where 

Po = 



'Af-l 

E 

. i=0 



j\[l]\[k-N 

i\ ^ (iV- 1)! 



Elementary calculations show that 



F{xi^^ >N + N/2) = J2 



Po 



k=N+N/2 

N^ ^ fN-1 

k=N+N/2 ^ 

N^ /iV_i\^+^/2 



(iV-1)^^ fN-iy^ ^ (N-lY'^ 



{N -ly. \ N J - \ N 



We then have 

limsupP(xl^' > 3/2) ^ limsupP(xi^' > iV-f 7V/2) < e"^ < 1. 
Using the distribution of xi^\ it can also be shown that 
sup E[X^ ] = sup — < 3. 

(AT) 

An application of Markov's inequality then shows that the sequence of {X^, }jvgn 

is tight. Thus, (|7.70p clearly shows that X^ does not converge (even along a 
subsequence) to 2 as — cx). 

A minor modification of the above example shows that the interchange of lim- 
its can also fail to hold in the presence of abandonments. For the same sequence 
of queues described above, suppose that customers abandon the queue according 
to a non-trivial patience time distribution G"" satisfying Assumption 2] and hav- 
ing support in (3,cx)). For each N € N. consider the marginal state process 
(A^^', 77^^)). Suppose that there exists (2,I7o,%) G So such that, a.s., as 
A ^ oo, 

(7.70) (A^^^(0),F(^\7jr^) ^ (2,Fo,%). 
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Given the assumption imposed on the patience time distribution, Assumption 2 fails 
to hold because in this case Bi = [0,3]. By the previous argument. Assumptions 
m and 13] are satisfied. Since Assumptions [1] [3] and S] ensure that the conditions 
of the fluid limit result. Theorem 3.6 of [14 , are satisfied, it follows that, 

N ^ oo, {X , j/^^) , 77*^^' ) converges weakly to the unique solution {X,V,r]) of the 
fluid equations associated with (1. 2,T7o, TJg). By the exponentiality of the service 
time distribution, we have X{t) — X{0) — 2 and R{t) = for each t > 0. On 

the other hand, let F^^' — {a''^}, x[^\T'i^\rji^^) be the stationary distribution 
associated with the fiuid-scaled state process, which exists by Theorem 14.91 By a 
simple coupling argument, it can be shown that X^^^ is stochastically dominated 
by the corresponding state X'^^ of an M/M/N queue without abandonment that 
has the same arrival process and the same initial condition (i.e., P(X(^) > 

c) > P(X(^) > c) for every c > 0). Together with the previous discussion of the 

case without abandonment, this can be used to show that limsup^y^oo ^ 
3/2) < 1 and {x|,^''}ArgN is tight. Thus, in this case too, x[^'' = \imt^ooX^^\t) 
does not converge (even along a convergent subsequence) to 2 = limt_yoo X{t) — 

limt^oo liniAr^oo X {t), as N ^ oo. 

Appendix A. Proof of Theorem 17.11 

By Theorem 6.1 of [19], to show that the Feller process {Yt,J^t}t>o is ergodic, 
it suffices to establish the second assertion in Lemma IA.3I and Theorem IA.5I below 
which, respectively, show that the skeleton chain {KnlneN is '(/'-irreducible and that 
{Yt, J-t}t>o is positive Harris recurrent. Let 

Z = {{a, 0, 0, 0) £ y : ae[g+l, oo)}. 

For each Borel subset A of Z, there exists a Borel subset of [g+ 1, oo) such that 

(1.71) A^{{a,0,O,O)ey: a £ Fa}. 

Lemma A.l. There exists a strictly positive continuous function C on y such that 
for every y = (a, x, X^iLi ^Ui, ^Zj) & y, every Borel subset A C Z and every 

t>2g+l, 

(1.72) Fy{Y{t) eA)> C{y) f ^ lr^(a + t - .s)(l ~F{a + t- s))dF{s). 

Ja+2g+l 

Proof. At time t, if the state Y{t) is in the set A C Z, this means that, by time 
t, all customers in service at time with residual service times {ui, 1 < i < fc}, 
all customers in queue at time with residual patience times {zj, 1 < j < 1} and 
those new customers that arrived in the interval [0, t) have completed service (if 
they entered service before time t) and have run out of their patience (irrespective 
of whether or not they entered service). Now, we consider a subset of {w : Y{t, to) £ 
A}, in which (a) by time 2g+l < t, all the initial customers with residual patience 
times {zj, 1 < J < ^} and residual service times {wi, 1 < i < k} have finished 
their services (if they entered service) and run out of their patience (irrespective 
of whether or nor they entered service), (b) the first new customer arrived after 
2g+l, finished service before t and ran out of his/her patience time before t, (c) the 
difference between t and the arrival time of that customer lies in F^, and (d) the 
second new customer arrived after time t. Let Qa, Qad and Qtd, respectively, be 
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the events that property (a) holds, properties (a)-(d) hold and properties (b)~(d) 
hold. Then, for y ey, 

Fy{Y{t) eA)> PyiQad) - Py{Qa)Pv{Qbd\Qa), 

and, due to the independence assumptions on the service, patience and interarrival 
distributions, Py{Qbd\Qa) is greater than or equal to 

"+* dF(s) 
C^ia + t- s)G'{a + t - s)lr^(a + t - s)(l -F{a + t- s)) 

a+2e+l 1 - 



1 - F[a) Ja+2s+l 

where the last inequality holds because a + t — s > g + 1 when a + t — s G Ta- 
Let C{y) = ^y^Q-')'^^<^e+r)G^e+i) ^ g^^^^^ Assumption |ni;2), G'^iA) > and 

G^{A) > for any interval A with length bigger than g, Py{Qa), as a function of 
y € y, is positive and continuous. Thus C is a positive and continuous function on 
y, and the lemma is proved. □ 

Definition A. 2. Any Markov process {Xt} with topological state space X is said 
to he ^-irreducible if and only if there exists a a-finite measure tp on B{X), the 
Borel a-algebra on X such that for every x £ X and B £ B{X), 

F^{X{t) e B)dt>0 if^{B)>0. 

Let ip = m X 6q X 6o X So, where m{A) = TrT{An [g+ 1, oo)), where m is Lebesgue 
measure. Clearly, i/; is a cr-finite measure on {y,B{y)). 

Lemma A. 3. The Markov process {Yt,Ft} is ip -irreducible and the discrete-time 
Markov chain {Y{n)}n^fii is ip -irreducible. 

Proof Let B e B{y) be such that tp{B) > 0. Then ip{B n Z) > by the definition 
of ip. There is a Borel measurable set Tsnz C [g + l,oo) such that B Ci Z — 
{(a,0, 0,0) G y : a £ Tsnz} and m{TBnz) > 0. Fix y £ y. It follows from 
Lemma [A. II that there exists a strictly positive function C on y such that 



/>oo 

/ Py{Y{t) e Bnz)dt 

/ Py{Y{t) e Bnz)dt 

"'20+1 



04 

oo / pa+t 



> 

>/ C{y)[l lrsnAa + t-s){l-F{a + t~s))dF{s)\ dt 

J2Q+1 \J a+2Q+l J 

= C{y){\ - F{a + 2g+ 1)) [ (1 - F{t)) dt 

>o, 

where the equality follows from Fubini's theorem and the last inequality holds 
because C{y) > 0, ni{TBr\z) > and 1 — F{x) > for every x £ [0,oo) by 
Assumption ^3). This establishes the first assertion. On the other hand, for 
n> 2g+l, 

Py{Y{n) eB)> C{y) / lr«n^(a + " " ~F{a + n- s)) dF{s). 

J a+2Q+l 
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By Assumption [6l[3) and the fact that m{TBnz) > 0, it fohows that Py{Y{n) e 
B) > for all n sufficiently large. Hence {Y{n)}n£N is i/'-irreducible □ 

For each y £ y, B ^ I3{y) and each probability measure 11 on [0, oo), let 

/"OO 

ICu{y,B)= / Py{Y{t) e B)U{dt). 

Jo 

Lemma A. 4. There exists a probability measure 11 on [0, oo) and a function T : 
y X B{y) -> R+ such that 

(1) /Cn(j/, B) > T(i/, B) for ally £ y and every Borel measurable set B G B{y); 

(2) T{y,y)>0 for ally i^y; 

(3) T(-,B) is lower-semicontinuous for every B G I3{y). 

Proof. Let C be the strictly positive, continuous function C of Lemma [A. 11 Let 11 
be a probability measure with density function e^(*~^^~^) on [2g+ 1, oo). For each 
y ^y and B C Z, define 

/"OO /"OO 

T{y,B) = C(y)e"+2e+W e-^dF{s) {1 - F{t))lrAt)e-'dt, 

Ja+2g+l JQ 

and T{y, y \ Z) = 0. It is easy to see that for any Borel measurable set B G B{y), 
T{y, B) = T{y, B Ci Z) and T(-, B)is continuous. Moreover, T{y, y) = T{y, Z) > 0. 
Now, fix y G y and B G B{y). By Lemma [A. H we have 

ICn{y,B) 

= / Py{Y{t) G B)e-(*-2e-i)^^ 

> Py{Y{t) e Bnz)e~^'-^e^^Ut 

J2Q+1 

/•oc ra+t 

> / C{y) / Ir^nzic^ + t- s){l- F{a + t- s))dF{s)e-(^'-^<^~^'> dt 

J2g+1 Ja+2o+l 

/>oo poo 

= C(y)e"+2e+i / e-^dF{s) {1 ~ F{t))lrsnAt)e-'dt 



Ja+2g+l JO 

= T{y,BnZ)^T{y,B). 
Thus we have proved the lemma. □ 

Theorem A. 5. The Markov process Y is positive Harris recurrent. 

Proof. Lemma [A. 41 shows that F is a so-called T process (cf. Section 3.2 of [19\). 
and Lemma IA.3I shows that Y is ■0-irreducible. Now, Theorem 3.2 of [19] states 
that any ^'-irreducible T process Y is positive Harris recurrent if Y is bounded in 
probability on average, that is, for each y G y and e > 0, there exists a compact 
set B £B{y) such that 



1 /■* 

liminf- / Py{Y{s) e B)ds>l-e. 

t^oo t Jo 



However, this is satisfied by the state process Y due to Lemma l4~8l So we have the 
desired result. □ 
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